Arithmetic decoding method and arithmetic coding method

ABSTRACT

An arithmetic decoding method is a method in which a context variable specifying a probability of a possible value of each of elements included in a binary string corresponding to a value of a given variable is initialized and arithmetic decoding is performed, using the context variable. The method includes: determining, from among a plurality of initialization methods as a method of initializing the context variable, an initialization method corresponding to the given variable or a group which includes the given variable; and initializing the context variable using the determined initialization method.

TECHNICAL FIELD

The present invention relates to a method of initializing contextvariables used for context based binary arithmetic coding or contextbased binary arithmetic decoding.

BACKGROUND ART

A method called H.264/MPEG-4 AVC (hereinafter, simply referred to as“H.264”) is known as a method of coding and decoding moving pictures(Non-Patent Literature (NPL) 1). This method performs image compressionthrough moving picture compression process such as frequency conversion,quantization and the like. Furthermore, the method adopts variousentropy coding methods for reducing an amount of bits of a stream outputrelative to a code on which image compression has been performed.

In entropy coding methods, components of moving pictures may be used ascontexts. H.264 adopts, as one of such entropy coding methods, contextbased variable length coding (VLC) scheme (section 9.2 in NPL 1) whichswitches between Huffman coding tables using contexts. H.264 furtheradopts, as another entropy coding method, an arithmetic coding method(section 9.3 in NPL 1) in which the value of a given variable istransformed into a binary string, and the probability of the value (0or 1) of each element in the binary string is controlled using acontext. In H.264, this arithmetic coding method, in which theprobability of a binary value is given based on the context, is referredto as context-based adaptive binary arithmetic coding (CABAC).

In CABAC, a context is initialized on a per slice basis. Morespecifically, every time a slice which includes a current block to becoded or decoded changes, context variables for specifying theprobability of the value of each element included in a binary string isinitialized.

CITATION LIST Non Patent Literature

-   [NPL 1]-   ITU-T H.264 (March 2010)

SUMMARY OF INVENTION Technical Problem

However, in conventional initialization of context variables, a singleinitialization method is substantially used for initializing all thecontext variables; and thus, the context variables may be improperlyinitialized.

The present invention has been conceived to solve such a problem, andhas an object to provide an arithmetic decoding method and an arithmeticcoding method for properly initializing context variables to increasecoding efficiency.

Solution to Problem

In order to achieve the object, an arithmetic decoding method accordingto one aspect of the present invention is an arithmetic decoding methodin which a context variable is initialized and arithmetic decoding isperformed, using the context variable, on a binary string whichcorresponds to a value of a given variable, the context variablespecifying a probability of a possible value of each of elementsincluded in the binary string. The arithmetic decoding method includes:determining an initialization method from among a plurality ofinitialization methods as a method of initializing the context variable,the initialization method corresponding to the given variable or a groupwhich includes the given variable; and initializing the context variableusing the determined initialization method.

Furthermore, in order to achieve the object, an arithmetic coding methodaccording to one aspect of the present invention is an arithmetic codingmethod in which a context variable is initialized and arithmetic codingis performed, using the context variable, on a binary string whichcorresponds to a value of a given variable, the context variablespecifying a probability of a possible value of each of elementsincluded in the binary string. The arithmetic coding method includes:determining an initialization method from among a plurality ofinitialization methods as an initialization method of the contextvariable, the determined initialization method corresponding to thegiven variable or a group which includes the given variable; andinitializing the context variable using the determined initializationmethod.

Advantageous Effects of Invention

According to the present invention, it is possible to properlyinitialize context variables, and increase coding efficiency.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a flowchart of part of process for parsing a binary stringcoded according to CABAC.

FIG. 2 is a diagram for explaining correspondence between variables andcontext variables.

FIG. 3A is a diagram for explaining a method of initializing contextvariables.

FIG. 3B is another diagram for explaining a method of initializingcontext variables.

FIG. 4 is a block diagram showing an example of a configuration of animage decoding apparatus according to Embodiment 1.

FIG. 5 is a block diagram showing an example of a configuration of anarithmetic decoding unit according to Embodiment 1.

FIG. 6 is a flowchart of a method of initializing context variablesaccording to Embodiment 1.

FIG. 7 is a diagram for explaining correspondence between variables(variable groups) and context indexes, according to Embodiment 1.

FIG. 8 is a diagram showing correspondence between first to n-thinitialization methods and control parameters, according to Embodiment1.

FIG. 9 shows an overall configuration of a content providing system forimplementing content distribution services.

FIG. 10 shows an overall configuration of a digital broadcasting system.

FIG. 11 shows a block diagram illustrating an example of a configurationof a television.

FIG. 12 shows a block diagram illustrating an example of a configurationof an information reproducing/recording unit that reads and writesinformation from and on a recording medium that is an optical disk.

FIG. 13 shows an example of a configuration of a recording medium thatis an optical disk.

In FIG. 14, (a) shows an example of a cellular phone, and (b) is a blockdiagram showing an example of a configuration of a cellular phone.

FIG. 15 illustrates a structure of multiplexed data.

FIG. 16 schematically shows how each stream is multiplexed inmultiplexed data.

FIG. 17 shows how a video stream is stored in a stream of PES packets inmore detail.

FIG. 18 shows a structure of TS packets and source packets in themultiplexed data.

FIG. 19 shows a data structure of a PMT.

FIG. 20 shows an internal structure of multiplexed data information.

FIG. 21 shows an internal structure of stream attribute information.

FIG. 22 shows steps for identifying video data.

FIG. 23 shows an example of a configuration of an integrated circuit forimplementing the moving picture coding method and the moving picturedecoding method according to each of embodiments.

FIG. 24 shows a configuration for switching between driving frequencies.

FIG. 25 shows steps for identifying video data and switching betweendriving frequencies.

FIG. 26 shows an example of a look-up table in which video datastandards are associated with driving frequencies.

In FIG. 27, (a) is a diagram showing an example of a configuration forsharing a module of a signal processing unit, and (b) is a diagramshowing another example of a configuration for sharing a module of thesignal processing unit.

DESCRIPTION OF EMBODIMENTS

First, a description is given of background to the present invention.

FIG. 1 is a flowchart of part of process for parsing a binary stringcoded according to CABAC. More specifically, FIG. 1 is a flowchart ofpart of “CABAC parsing process for slice data” which is extracted fromFIG. 9-1 of NPL 1, H.264(09)_F9-1, and which is a process for parsing abinary string output as a result of coding a variable syntax element(SE) according to CABAC (including binarization process).

In H.264, CABAC coding is applied to a group of variables (defined byae(v) type) included in the data structure which corresponds to asubstantial portion of an image. The data structure which corresponds tothe substantial portion of an image currently refers to, for example,data in a layer of slice data or lower layer (slice data (clause 7.3.4),or macroblock layer (clause 7.3.5).

On the other hand, CABAC coding is not applied to layers which arehigher than slice data and which give control parameters for the slicedata (slice header (clause 7.3.3), variables such as picture parameterset which gives control parameters for slices). Note that a variablerefers to a variable given according to a rule of the data structure, ora variable derived according to a rule of the data structure. In thepresent invention, a variable refer to a variable included in the datastructure of a coded stream. In the present description, SE refers to asyntax element, and is a variable (variable name).

In step S502, it is determined if a given variable (SE) is a firstvariable (SE) in a slice, regardless of its value (S502). Thisdetermination is for determining if initialization of context variablescorresponding to the variable is necessary. For example, when a sliceincludes a plurality of macroblocks, and if the variable is associatedwith a first macroblock, the result of the determination is YES. If thevariable is associated with a second or subsequent macroblock, and is avariable (SE) that is of a same type as the variable associated with thefirst macroblock, the result of the determination is NO. This is becauseeven if the values of the variables are different, the variable of thistype has already been initialized.

When the result of the determination of Step S502 is YES, initializationof context variables indicated by ctxIdx corresponding to the variableis executed (S503).

FIG. 2 is a diagram for explaining correspondence between variable (SE)and ctxIdx. More specifically, FIG. 2 is a table showing correspondencebetween variables and context indexes (ctxIdx) according to aconventional technique (H.264). The upper line indicates variables(signal type, SE), and the lower line indicates each ctxIdxcorresponding to the upper variable.

For example, in the case where a variable (SE) is 5, and isCoded_block_pattern (luma), this variable is associated with a contexthaving context indexes of 70 . . . 72 (70 or greater and 72 or smaller,hereinafter, same expression is used for expressing a range).Furthermore, in the case where a variable (SE) is 6, and isCoded_block_pattern (chroma), this variable is associated with contextindexes of 73 . . . 76 so as not to overlap the other variables. In thesimilar manner, a variable (array type) Significant_coeff and a variable(array type) Last_significant_coeff are associated with differentcontext indexes so as not to overlap each other for each of groups whichgroup variables represented by data structure.

FIG. 3A and FIG. 3B each is a diagram for explaining a method ofinitializing context variables which correspond to a given variable.More specifically, FIG. 3A is a flowchart of a method of initializingcontext variables specified by respective context indexes derived inStep S503 (Initialization of context variables) in FIG. 1. FIG. 3B is adiagram showing a calculation method used in the method of initializingcontext variables. In other words, FIG. 3B shows calculating formulasapplied to all of the ctxIdx (0 to 1023).

In this initialization method, (1) an initial value of pStatedIdx whichindicates one of 64 groups from 0 to 63 to which the probabilitybelongs, and (2) an initial value of vaIMPS which indicates one of twovalues “0” and “1” which has a higher probability, are substantiallyderived by a single dynamic control parameter SliceQPy.

As shown in FIG. 3B, in order to determine the preStatedIdx (0 . . .63), preCtxState(1 . . . 126) is first derived. Here, m and n areconstant numbers which respectively give a slope (m) and an intercept(n) in a case where preCtxState(y) is represented by a liner function ofSliceQPy(x), and are statically determined in advance. Hence, thisinitialization method can be referred to as an initialization methodsubstantially using a single control parameter (SliceQPy).

SliceQPy in H.264 is an initial value of QPy which is applied to eachslice according to the value of the variable pic_init_qp_minus26specified by a slice header per slice. This is a variable whichrepresents an initial value of a quantization parameter for luminanceapplied to a slice (H.264 standard format 8-422 etc).

Hence, it is improper to initialize context variables corresponding to,for example, coded_block_pattern(chroma) that is a variable forchrominance, using only the value for luminance as a control parameter.In other words, it is not always proper to initialize context variablesusing the single initialization method determined only by the variableQPy for luminance.

Furthermore, the inventors are studying the following matters regardingrelated techniques.

More specifically, the inventors are studying formation of groups (firstgroup to n-th group) in a view different from individual variabledefined by the data structure (including a case where a differentcoefficient position is also counted as one variable). One view for theformation of groups is “types of control parameters”. In this study, theinventors have found out that the initialization process describedabove, in which the control parameter “QPy” (quantization parameter forluminance) is statically used, is not the best for variables included ingroups (first to n-th groups) formed based on the types of controlparameters (#1 to #n).

Furthermore, when studying application of arithmetic coding applied tothe image data portion (slice data layer or lower layers) extending toparameters for higher layers (including QP itself that is a controlparameter), the inventors have found out that another control parameteris necessary which is different from QP for optimal initialization.

The arithmetic decoding method according to one aspect of the presentinvention is an arithmetic decoding method in which a context variableis initialized and arithmetic decoding is performed, using the contextvariable, on a binary string which corresponds to a value of a givenvariable, the context variable specifying a probability of a possiblevalue of each of elements included in the binary string. The arithmeticdecoding method includes: determining an initialization method fromamong a plurality of initialization methods as a method of initializingthe context variable, the initialization method corresponding to thegiven variable or a group which includes the given variable; andinitializing the context variable using the determined initializationmethod.

Furthermore, in the arithmetic decoding method according to anotheraspect of the present invention, it is preferable that at least one ofthe initialization methods depends on a quantization step forchrominance.

Furthermore, in the arithmetic decoding method according to anotheraspect of the present invention, it is preferable that at least one ofthe initialization methods depends on a maximum number of referencepictures.

Furthermore, in the arithmetic decoding method according to anotheraspect of the present invention, it is preferable that at least one ofthe initialization methods depends on a resolution of a picture.

Furthermore, in the arithmetic decoding method according to anotheraspect of the present invention, it is preferable that at least one ofthe initialization methods depends on a position of a slice.

Furthermore, the arithmetic coding method according to one aspect of thepresent invention is an arithmetic coding method in which a contextvariable is initialized and arithmetic coding is performed, using thecontext variable, on a binary string which corresponds to a value of agiven variable, the context variable specifying a probability of apossible value of each of elements included in the binary string. Thearithmetic coding method includes: determining an initialization methodfrom among a plurality of initialization methods as an initializationmethod of the context variable, the determined initialization methodcorresponding to the given variable or a group which includes the givenvariable; and initializing the context variable using the determinedinitialization method.

Furthermore, in the arithmetic coding method according to another aspectof the present invention, it is preferable that at least one of theinitialization methods depends on a quantization step of chrominance.

Furthermore, in the arithmetic coding method according to another aspectof the present invention, it is preferable that at least one of theinitialization methods depends on a maximum number of referencepictures.

Furthermore, in the arithmetic coding method according to another aspectof the present invention, it is preferable that at least one of theinitialization methods depends on a resolution of a picture.

Furthermore, in the arithmetic coding method according to another aspectof the present invention, it is preferable that at least one of theinitialization methods depends on a position of a slice.

Hereinafter, detailed descriptions are given of embodiments of thepresent invention, referring to the drawings. Each of the embodimentsdescribed below shows a general or specific example. The numericalvalues, shapes, materials, structural elements, the arrangement andconnection of the structural elements, steps, the processing order ofthe steps etc. shown in the following embodiments are mere examples, andtherefore do not limit the present invention. The present invention isdefined based on the Claims. Therefore, among the structural elements inthe following embodiments, structural elements not recited in any one ofthe independent claims are not necessarily required to achieve theobject of the present invention, but are described as structuralelements for preferable embodiments.

Embodiment 1

FIG. 4 is a block diagram showing an example of a configuration of animage decoding apparatus 400 according to Embodiment 1. FIG. 5 is ablock diagram showing an example of a configuration of an arithmeticdecoding unit 300 according to Embodiment 1.

The arithmetic decoding unit 300 according to Embodiment 1 is includedin the image decoding apparatus 400 which decodes coded image datagenerated by compression coding. First, a description is given of theimage decoding apparatus 400 shown in FIG. 4.

The image decoding apparatus 400 decodes coded image data generated bycompression coding. For example, the image decoding apparatus 400receives, on a per block basis, coded image data as a current signal tobe decoded. The image decoding apparatus 400 performs entropy decoding,inverse quantization, and inverse transformation on the received signalto be decoded, to reconstruct image data.

As shown in FIG. 4, the image decoding apparatus 400 includes: anentropy decoding unit 410; an inverse quantization and inversetransformation unit 420; an adder 425; a deblocking filter 430; a memory440; an intra prediction unit 450; a motion compensation unit 460; andan intra and inter changing switch 470.

The entropy decoding unit 410 performs entropy decoding on an inputsignal (an input stream) to reconstruct quantized coefficients. Theinput signal (input stream) here refers to a current signal to bedecoded, and corresponds to data in each block of coded image data.Furthermore, the entropy decoding unit 410 obtains motion data from theinput signal, and outputs the obtained motion data to the motioncompensation unit 460.

The inverse quantization and inverse transformation unit 420 performsinverse quantization on the quantized coefficients reconstructed by theentropy decoding unit 410 to reconstruct transform coefficients. Theinverse quantization and inverse transformation unit 420 performsinverse transformation on the reconstructed transform coefficients, toreconstruct a prediction residual signal.

The adder 425 adds the reconstructed prediction residual signal and aprediction signal to generate a decoded image.

The deblocking filter 430 performs deblocking filtering on the generateddecoded image. The decoded image on which deblocking filtering has beenperformed is output as a decoded signal.

The memory 440 is a memory for storing reference images to be used formotion compensation. More specifically, the memory 440 stores thedecoded image on which deblocking filtering has been performed.

The intra prediction unit 450 performs intra prediction to generate aprediction signal (intra prediction signal). More specifically, theintra prediction unit 450 generates an intra prediction signal byperforming intra prediction referring to images surrounding the currentblock to be decoded (input signal) in the decoded image generated by theadder 425.

The motion compensation unit 460 performs motion compensation based onthe motion data output from the entropy decoding unit 410 to generate aprediction signal (inter prediction signal).

The intra and inter changing switch 470 selects one of the intraprediction signal and the inter prediction signal, and outputs theselected signal to the adder 425 as a prediction signal.

With the configuration above, the image decoding apparatus 400 accordingto Embodiment 1 decodes coded image data on which compression coding hasbeen performed.

In FIG. 4, the arithmetic decoding unit 300 according to Embodiment 1shown in FIG. 5 is included in the entropy decoding unit 410. Morespecifically, the arithmetic decoding unit 300 performs arithmeticdecoding and debinarization on the coded image data on which predictioncoding has been performed as an input stream IS. The signal typeinformation SE is information which indicates, for example, the positionof the quantized coefficient, the motion data, the direction of intraprediction used by the intra prediction unit 450.

Here, a description is given of the arithmetic decoding unit 300 shownin FIG. 5.

As shown in FIG. 5, the arithmetic decoding unit 300 includes: a binaryarithmetic decoder 301; a symbol probability storing unit 302; a contextcontrol unit 303; and a debinarization unit 304.

The binary arithmetic decoder 301 performs arithmetic decoding on theinput stream IS using probability information PE output from the symbolprobability storing unit 302, to output a binary signal OBIN.

The symbol probability storing unit 302 stores, on a per context basis,context variables for specifying probability. The symbol probabilitystoring unit 302 outputs probability PE to the binary arithmetic decoder301, according to an instruction from the context control unit 303.

The context control unit 303 specifies the context which corresponds tothe variable SE, and causes the symbol probability storing unit 302 tooutput the probability PE specified by the context variables of thecontext. The context control unit 303 updates the context variablesstored in the symbol probability storing unit 302 to update theprobability according to the value of the binary signal OBIN.

Furthermore, the context control unit 303 initializes the contextvariables stored in the symbol probability storing unit 302 wheninitialization of the context variables is necessary. A detaileddescription is given later of the initialization of the contextvariables.

The debinarization unit 304 performs debinarization on the binary signalOBIN to output quantized coefficient, motion data, or the like.

The initialization process of the context variables according toEmbodiment 1 is executed by the context control unit 303. The otherprocessing units (for example, a context group control unit (not shown))is capable of determining or changing a group according to the value ofa control signal, and providing a variable (or a group of variables(first to n-th groups) to the context control unit 303.

The coding apparatus and the decoding apparatus have to use commonprobability (or update model of probability). This is because if thecoding apparatus which generates one range (the values which represent arange on a number line) and the decoding apparatus which interprets thevalues (range) do not use the same probability model (initialprobability value, update rule), the framework of the arithmetic codingand decoding fails. Accordingly, the coding apparatus also performs thesame context initialization process as that performed by the decodingapparatus, after the value of the control parameter is determined.

FIG. 6 is a flowchart of the process of initialization of contextvariables according to Embodiment 1. This initialization process isexecuted by the context control unit 303 when initialization of thecontext variables corresponding to a variable to be arithmetic coded isnecessary.

First, in step S101, the context control unit 303 determines which oneof the first to n-th groups a variable to be parsed (a given variable)belongs to (S101). For example, the groups of the variables as shown inFIG. 7 are used.

Each group may be set for a group of variables, or for a group ofcontexts. Furthermore, each group does not always have to be setstatically, but may be set dynamically. In the case where the groupsdynamically change (or where the groups are specified by the codingside), the groups may be specified using indexes.

Next, in the case where the groups are 1, 2, . . . etc, the contextcontrol unit 303 executes different initialization methods (any one ofthe first to n-th initialization methods (where n is an integer numbergreater than or equal to 2)) depending on the groups (S103, S105 . . .). Specifically, the context control unit 303 first determines, fromamong a plurality of initialization methods, an initialization methodwhich corresponds to the determined group. The context control unit 303then initializes the context variables corresponding to the variable tobe parsed, using the determined initialization method.

Here, the initialization methods are associated with groups, but do notalways have to be associated with the groups. For example, theinitialization methods may be associated with variables to be parsed.Specifically, the context control unit 303 may determine, from among aplurality of initialization methods, an initialization methodcorresponding to a variable to be parsed.

Furthermore, the context control unit 303 may determine aninitialization method corresponding to the group or variable, by, forexample, referring to information which associates a group or a variablewith an initialization method. It is sufficient that such information isstored, for example, in a storage unit (memory) or the like not shown.

FIG. 8 is a diagram showing correspondence between the first to n-thinitialization methods (init_method[1 . . . i]) and combinations of 0 ormore control parameters used for each initialization method. In thetable shown in FIG. 8, rows indicate initialization method numbers, andcolumns indicate control parameter numbers (first to j-th controlparameters). The coefficient a(i, j) specified by row and column numbershas, for example, the value of “0” or “1”. The context control unit 303is capable of specifying the parameters to be used by the first to n-thinitialization methods, by referring to the table.

For example, the first initialization method (init_method[1]) uses onlya first control parameter (param#1) as a control parameter. In thiscase, it is sufficient to be set in such a manner that a(1, 1)=1, anda(1, 2 . . . j)=0.

In such a manner, it is possible to provide valid or invalid state ofthe control parameters (param#1 to #j) or the degree of the applicationof the control parameters used in any initialization methods (the firstto n-th initialization methods).

The following describes specific examples of respective controlparameters. The control parameters described below are examples, and thecontrol parameters according to the present invention are not limited tosuch control parameters.

The first control parameter (param#1) is, for example, a quantizationstep for luminance. Specifically, at least one of the first to n-thinitialization methods may depend on the quantization step forluminance. Accordingly, as in the conventional method, it is possible toreflect, to the initialization method, the degree of correlation betweena binary string and a quantization step for luminance.

The second control parameter (param#2) is, for example, a quantizationstep for chrominance. Specifically, at least one of the first to n-thinitialization methods may depend on the quantization step forchrominance.

In the conventional method, only the degree of correlation between abinary string and a quantization step for luminance can be reflected tothe initialization process. According to the method in Embodiment 1, thedegree of correlation between a binary string and a quantization stepfor chrominance can also be reflected to the initialization process,using coding information on a chrominance signal. As a result,initialization process can be performed using the fact that the amountof information on chrominance is likely to increase when thequantization step for chrominance is smaller, allowing further increasein coding efficiency.

Here, the coding information on a chrominance signal refers to, forexample, information on a prediction mode for chrominance, orinformation on coding of quantized coefficient for chrominance. Morespecifically, the coding information on a chrominance signal refers toinformation for distinguishing zero coefficient and non-zerocoefficient, or information indicating the last position of a non-zerocoefficient in a transform block.

The third control parameter (param#3) is, for example, the maximumnumber of reference frames. Specifically, at least one of the first ton-th initialization methods may depend on the maximum number ofreference pictures.

In the conventional method, only the degree of correlation between abinary string and a quantization step of luminance can be reflected tothe initialization process. According to the above method in Embodiment1, it is possible to reflect the degree of correlation between a binarystring and the maximum number of reference frames to the initializationprocess, using the coding information on the maximum number of referenceframes. As a result, the initialization process can be performed usingthe fact that the amount of information on prediction of time directiondecreases when the maximum number of reference frames is larger,allowing further increase in coding efficiency.

Here, the coding information on the maximum number of reference framesrefers to, for example, information on motion prediction, or informationon coding of motion vector. More specifically, the coding information onthe maximum number of reference frames refers to, for example,information indicating a prediction reference direction, a size ofmotion vector, or an index of the frame to be referenced.

It has been described in this example that the third control parameter(param#3) is the maximum number of reference frames, but, for example,it may be replaced with information on inter-prediction. Furthermore,for example, the third control parameter (param#3) may be informationindicating a frame rate of an input image signal. In this case, too, theinitial value can be adjusted using the fact that the temporalcorrelation increases when the frame rate is higher, allowing furtherincrease in coding efficiency.

The fourth control parameter (param#4) is, for example, the resolutionof a picture which includes the slice, which is given by a givenparameter. Specifically, at least one of the first to n-thinitialization methods may depend on the resolution of a picture.

In the conventional method, only the correlation degree between a binarystring and a quantization step for luminance can be reflected to theinitialization process. According to the method above in Embodiment 1,the correlation degree between a binary string and the resolution of aninput image can be reflected to the initialization process, using thecoding information on the resolution of an input signal. As a result,the initialization process can be performed using the fact that the sizeof unit of the processing block is likely to increase or the amount ofinformation included in a processing block is likely to decrease whenthe resolution is higher, allowing further increase in codingefficiency.

Here, the coding information on the resolution of an input signal refersto, for example, information on a unit of coding, or information oncoding of quantized coefficient. More specifically, the codinginformation on the resolution of an input signal is, for example,information for distinguishing zero coefficient and non-zerocoefficient, or information indicating the last position of a non-zerocoefficient in a transform block.

The fifth control parameter (param#5) is, for example, a signalindicating the difference of slices (the position in a space of acurrent slice to be decoded). Specifically, at least one of the first ton-th initialization methods may depend on the position of the slice in apicture.

In the conventional method, only the correlation degree between a binarystring and a quantization step for luminance can be reflected to theinitialization process. According to the method above in Embodiment 1,correlation degree between a binary string and the characteristics of aslice can be reflected to the initialization process, using the codinginformation on slice characteristics. As a result, the initializationprocess can be performed using the fact that a non-reference slice(slice that is not referenced by another slice) is likely to have largerreduction in image quality, allowing further increase in codingefficiency.

Here, the coding information on the slice characteristics is, forexample, information on the position of a slice, or information on thedifference of slice coding methods.

A control parameter may have a fixed value. The fixed value may be thesame value as n (the number of control parameters).

Here, the first to n-th control parameters may be independent from oneanother. Furthermore, it may also be that the first control parameterdoes not uniquely determine the other control parameters.

Furthermore, a control parameter may be another variable in the sameslice, and may be (the value of) the signal type previously obtained byarithmetic decoding.

As described above, according to Embodiment 1, for initialization ofcontext variables for a given group (a plurality of context Idx), aninitial value of a probability can be set by switching into aninitialization method using a control parameter suited for theinformation type (group).

Furthermore, with respect to group information or the like, theprocessing unit to be used may be determined in advance for each signaltype to be coded, or may be changed according to header information (forexample, information indicating a profile or another control parameter).Accordingly, it is possible to change initialization methods accordingto the characteristics of an input signal, allowing further increase incoding efficiency.

The correspondence between groups and indexes may be in such a relationthat one of them includes the other. The important thing here is, in therelation among variables, indexes and initialization methods, the valuesof variables (or the value of each element in a binary string or thelike) have a higher correlation (farther from 0, regardless of positiveor negative value) with the values of the control parameters used in theinitialization methods. For example, an initialization method differentfrom the initialization method of H.264 which uses QP shown in FIG. 3Aand FIG. 3B is applied to context variables for a second variable havinga lower correlation with the value of the control parameter QP than thefirst variable. It is sufficient that a plurality of indexes areincluded in one group, to apply the same probability model as that ofH.264 is applied to the present invention.

Descriptions have been given of the example where each element in astring have one of two values, 0 and 1. However, also in a case whereeach element have an n-bit multivalue or any one of three values, thepresent invention may be, of course, applied by selecting an appropriatecontrol parameter for initialization of probability.

The initialization methods of context variables according to Embodiment1 may also be applied to arithmetic coding methods. Specifically,context variables may be initialized, as shown in FIG. 6 to FIG. 8, inthe arithmetic coding methods, too. Accordingly, the same advantageouseffects can be obtained as the arithmetic decoding method above.

Embodiment 2

The processing described in Embodiment 1 can be simply implemented in anindependent computer system, by recording, in a recording medium, aprogram for implementing the configurations of the moving picture codingmethod (image coding method) and the moving picture decoding method(image decoding method) described in Embodiment 1. The recording mediamay be any recording media as long as the program can be recorded, suchas a magnetic disk, an optical disk, a magnetic optical disk, an ICcard, and a semiconductor memory.

Hereinafter, the applications to the moving picture coding method (imagecoding method) and the moving picture decoding method (image decodingmethod) described in Embodiment 1 and systems using thereof will bedescribed. The system has a feature of having an image coding anddecoding apparatus that includes an image coding apparatus using theimage coding method and an image decoding apparatus using the imagedecoding method. Other configurations in the system can be changed asappropriate depending on the cases.

FIG. 9 illustrates an overall configuration of a content providingsystem ex100 for implementing content distribution services. The areafor providing communication services is divided into cells of desiredsize, and base stations ex106, ex107, ex108, ex109, and ex110 which arefixed wireless stations are placed in each of the cells.

The content providing system ex100 is connected to devices, such as acomputer ex111, a personal digital assistant (PDA) ex112, a cameraex113, a cellular phone ex114 and a game machine ex115, via the Internetex101, an Internet service provider ex102, a telephone network ex104, aswell as the base stations ex106 to ex110, respectively.

However, the configuration of the content providing system ex100 is notlimited to the configuration shown in FIG. 9, and a combination in whichany of the elements are connected is acceptable. In addition, eachdevice may be directly connected to the telephone network ex104, ratherthan via the base stations ex106 to ex110 which are the fixed wirelessstations. Furthermore, the devices may be interconnected to each othervia a short distance wireless communication and others.

The camera ex113, such as a digital video camera, is capable ofcapturing video. A camera ex116, such as a digital camera, is capable ofcapturing both still images and video. Furthermore, the cellular phoneex114 may be the one that meets any of the standards such as GlobalSystem for Mobile Communications (GSM) (registered trademark), CodeDivision Multiple Access (CDMA), Wideband-Code Division Multiple Access(W-CDMA), Long Term Evolution (LTE), and High Speed Packet Access(HSPA). Alternatively, the cellular phone ex114 may be a PersonalHandyphone System (PHS).

In the content providing system ex100, a streaming server ex103 isconnected to the camera ex113 and others via the telephone network ex104and the base station ex109, which enables distribution of images of alive show and others. In such a distribution, a content (for example,video of a music live show) captured by the user using the camera ex113is coded as described above in each of embodiments (i.e., the camerafunctions as the image coding apparatus according to an aspect of thepresent invention), and the coded content is transmitted to thestreaming server ex103. On the other hand, the streaming server ex103carries out stream distribution of the transmitted content data to theclients upon their requests. The clients include the computer ex111, thePDA ex112, the camera ex113, the cellular phone ex114, and the gamemachine ex115 that are capable of decoding the above-mentioned codeddata. Each of the devices that have received the distributed datadecodes and reproduces the coded data (i.e., functions as the imagedecoding apparatus according to an aspect of the present invention).

The captured data may be coded by the camera ex113 or the streamingserver ex103 that transmits the data, or the coding processes may beshared between the camera ex113 and the streaming server ex103.Similarly, the distributed data may be decoded by the clients or thestreaming server ex103, or the decoding processes may be shared betweenthe clients and the streaming server ex103. Furthermore, the data of thestill images and video captured by not only the camera ex113 but alsothe camera ex116 may be transmitted to the streaming server ex103through the computer ex111. The coding processes may be performed by thecamera ex116, the computer ex111, or the streaming server ex103, orshared among them.

Furthermore, the coding and decoding processes may be performed by anLSI ex500 generally included in each of the computer ex111 and thedevices. The LSI ex500 may be configured of a single chip or a pluralityof chips. Software for coding and decoding video may be integrated intosome type of a recording medium (such as a CD-ROM, a flexible disk, anda hard disk) that is readable by the computer ex111 and others, and thecoding and decoding processes may be performed using the software.

Furthermore, when the cellular phone ex114 is equipped with a camera,the video data obtained by the camera may be transmitted. The video datais data coded by the LSI ex500 included in the cellular phone ex114.

Furthermore, the streaming server ex103 may be composed of servers andcomputers, and may decentralize data and process the decentralized data,record, or distribute data.

As described above, the clients may receive and reproduce the coded datain the content providing system ex100. In other words, the clients canreceive and decode information transmitted by the user, and reproducethe decoded data in real time in the content providing system ex100, sothat the user who does not have any particular right and equipment canimplement personal broadcasting.

Aside from the example of the content providing system ex100, at leastone of the moving picture coding apparatus (image coding apparatus) andthe moving picture decoding apparatus (image decoding apparatus)described in the above embodiment may be implemented in a digitalbroadcasting system ex200 illustrated in FIG. 10. More specifically, abroadcast station ex201 communicates or transmits, via radio waves to abroadcast satellite ex202, multiplexed data obtained by multiplexingaudio data and others onto video data. The video data is data coded bythe moving picture coding method described in the above embodiment(i.e., data coded by the image coding apparatus according to an aspectof the present invention). Upon receipt of the multiplexed data, thebroadcast satellite ex202 transmits radio waves for broadcasting. Then,a home-use antenna ex204 with a satellite broadcast reception functionreceives the radio waves. Next, a device such as a television (receiver)ex300 and a set top box (STB) ex217 decodes the received multiplexeddata, and reproduces the decoded data (i.e., functions as the imagedecoding apparatus according to an aspect of the present invention).

Furthermore, a reader/recorder ex218 (i) reads and decodes themultiplexed data recorded on a recording medium ex215, such as a DVD anda BD, or (i) codes video signals in the recording medium ex215, and insome cases, writes data obtained by multiplexing an audio signal on thecoded data. The reader/recorder ex218 can include the moving picturedecoding apparatus or the moving picture coding apparatus as shown inthe above embodiment. In this case, the reproduced video signals aredisplayed on the monitor ex219, and can be reproduced by another deviceor system using the recording medium ex215 on which the multiplexed datais recorded. It is also possible to implement the moving picturedecoding apparatus in the set top box ex217 connected to the cable ex203for a cable television or to the antenna ex204 for satellite and/orterrestrial broadcasting, so as to display the video signals on themonitor ex219 of the television ex300. The moving picture decodingapparatus may be implemented not in the set top box but in thetelevision ex300.

FIG. 11 illustrates the television (receiver) ex300 that uses the movingpicture coding method and the moving picture decoding method describedin the above embodiment. The television ex300 includes: a tuner ex301that obtains or provides multiplexed data obtained by multiplexing audiodata onto video data, through the antenna ex204 or the cable ex203, etc.that receives a broadcast; a modulation/demodulation unit ex302 thatdemodulates the received multiplexed data or modulates data intomultiplexed data to be supplied outside; and amultiplexing/demultiplexing unit ex303 that demultiplexes the modulatedmultiplexed data into video data and audio data, or multiplexes videodata and audio data coded by a signal processing unit ex306 into data.

The television ex300 further includes: a signal processing unit ex306including an audio signal processing unit ex304 and a video signalprocessing unit ex305 that decode audio data and video data and codeaudio data and video data, respectively (which function as the imagecoding apparatus and the image decoding apparatus according to theaspects of the present invention); and an output unit ex309 including aspeaker ex307 that provides the decoded audio signal, and a display unitex308 that displays the decoded video signal, such as a display.Furthermore, the television ex300 includes an interface unit ex317including an operation input unit ex312 that receives an input of a useroperation. Furthermore, the television ex300 includes a control unitex310 that controls overall each constituent element of the televisionex300, and a power supply circuit unit ex311 that supplies power to eachof the elements. Other than the operation input unit ex312, theinterface unit ex317 may include: a bridge ex313 that is connected to anexternal device, such as the reader/recorder ex218; a slot unit ex314for enabling attachment of the recording medium ex216, such as an SDcard; a driver ex315 to be connected to an external recording medium,such as a hard disk; and a modem ex316 to be connected to a telephonenetwork. Here, the recording medium ex216 can electrically recordinformation using a non-volatile/volatile semiconductor memory elementfor storage. The constituent elements of the television ex300 areconnected to each other through a synchronous bus.

First, the configuration in which the television ex300 decodesmultiplexed data obtained from outside through the antenna ex204 andothers and reproduces the decoded data will be described. In thetelevision ex300, upon a user operation through a remote controllerex220 and others, the multiplexing/demultiplexing unit ex303demultiplexes the multiplexed data demodulated by themodulation/demodulation unit ex302, under control of the control unitex310 including a CPU. Furthermore, the audio signal processing unitex304 decodes the demultiplexed audio data, and the video signalprocessing unit ex305 decodes the demultiplexed video data, using thedecoding method described in the above embodiment, in the televisionex300. The output unit ex309 provides the decoded video signal and audiosignal outside, respectively. When the output unit ex309 provides thevideo signal and the audio signal, the signals may be temporarily storedin buffers ex318 and ex319, and others so that the signals arereproduced in synchronization with each other. Furthermore, thetelevision ex300 may read multiplexed data not through a broadcast andothers but from the recording media ex215 and ex216, such as a magneticdisk, an optical disk, and a SD card. Next, a configuration in which thetelevision ex300 codes an audio signal and a video signal, and transmitsthe data outside or writes the data on a recording medium will bedescribed. In the television ex300, upon a user operation through theremote controller ex220 and others, the audio signal processing unitex304 codes an audio signal, and the video signal processing unit ex305codes a video signal, under control of the control unit ex310 using thecoding method described in the above embodiment. Themultiplexing/demultiplexing unit ex303 multiplexes the coded videosignal and audio signal, and provides the resulting signal outside. Whenthe multiplexing/demultiplexing unit ex303 multiplexes the video signaland the audio signal, the signals may be temporarily stored in thebuffers ex320 and ex321, and others so that the signals are reproducedin synchronization with each other. Here, the buffers ex318, ex319,ex320, and ex321 may be plural as illustrated, or at least one buffermay be shared in the television ex300. Furthermore, data may be storedin a buffer so that the system overflow and underflow may be avoidedbetween the modulation/demodulation unit ex302 and themultiplexing/demultiplexing unit ex303, for example.

Furthermore, the television ex300 may include a configuration forreceiving an AV input from a microphone or a camera other than theconfiguration for obtaining audio and video data from a broadcast or arecording medium, and may code the obtained data. Although thetelevision ex300 can code, multiplex, and provide outside data in thedescription, it may be capable of only receiving, decoding, andproviding outside data but not the coding, multiplexing, and providingoutside data.

Furthermore, when the reader/recorder ex218 reads or writes multiplexeddata from or on a recording medium, one of the television ex300 and thereader/recorder ex218 may decode or code the multiplexed data, and thetelevision ex300 and the reader/recorder ex218 may share the decoding orcoding.

As an example, FIG. 12 illustrates a configuration of an informationreproducing/recording unit ex400 when data is read or written from or onan optical disk. The information reproducing/recording unit ex400includes constituent elements ex401, ex402, ex403, ex404, ex405, ex406,and ex407 to be described hereinafter. The optical head ex401 irradiatesa laser spot in a recording surface of the recording medium ex215 thatis an optical disk to write information, and detects reflected lightfrom the recording surface of the recording medium ex215 to read theinformation. The modulation recording unit ex402 electrically drives asemiconductor laser included in the optical head ex401, and modulatesthe laser light according to recorded data. The reproductiondemodulating unit ex403 amplifies a reproduction signal obtained byelectrically detecting the reflected light from the recording surfaceusing a photo detector included in the optical head ex401, anddemodulates the reproduction signal by separating a signal componentrecorded on the recording medium ex215 to reproduce the necessaryinformation. The buffer ex404 temporarily holds the information to berecorded on the recording medium ex215 and the information reproducedfrom the recording medium ex215. The disk motor ex405 rotates therecording medium ex215. The servo control unit ex406 moves the opticalhead ex401 to a predetermined information track while controlling therotation drive of the disk motor ex405 so as to follow the laser spot.The system control unit ex407 controls overall the informationreproducing/recording unit ex400. The reading and writing processes canbe implemented by the system control unit ex407 using variousinformation stored in the buffer ex404 and generating and adding newinformation as necessary, and by the modulation recording unit ex402,the reproduction demodulating unit ex403, and the servo control unitex406 that record and reproduce information through the optical headex401 while being operated in a coordinated manner. The system controlunit ex407 includes, for example, a microprocessor, and executesprocessing by causing a computer to execute a program for read andwrite.

Although the optical head ex401 irradiates a laser spot in thedescription, it may perform high-density recording using near fieldlight.

FIG. 13 illustrates the recording medium ex215 that is the optical disk.On the recording surface of the recording medium ex215, guide groovesare spirally formed, and an information track ex230 records, in advance,address information indicating an absolute position on the diskaccording to change in a shape of the guide grooves. The addressinformation includes information for determining positions of recordingblocks ex231 that are a unit for recording data. Reproducing theinformation track ex230 and reading the address information in anapparatus that records and reproduces data can lead to determination ofthe positions of the recording blocks. Furthermore, the recording mediumex215 includes a data recording area ex233, an inner circumference areaex232, and an outer circumference area ex234. The data recording areaex233 is an area for use in recording the user data. The innercircumference area ex232 and the outer circumference area ex234 that areinside and outside of the data recording area ex233, respectively arefor specific use except for recording the user data. The informationreproducing/recording unit 400 reads and writes coded audio, coded videodata, or multiplexed data obtained by multiplexing the coded audio andvideo data, from and on the data recording area ex233 of the recordingmedium ex215.

Although an optical disk having a layer, such as a DVD and a BD isdescribed as an example in the description, the optical disk is notlimited to such, and may be an optical disk having a multilayerstructure and capable of being recorded on a part other than thesurface. Furthermore, the optical disk may have a structure formultidimensional recording/reproduction, such as recording ofinformation using light of colors with different wavelengths in the sameportion of the optical disk and for recording information havingdifferent layers from various angles.

Furthermore, a car ex210 having an antenna ex205 can receive data fromthe satellite ex202 and others, and reproduce video on a display devicesuch as a car navigation system ex211 set in the car ex210, in thedigital broadcasting system ex200. Here, a configuration of the carnavigation system ex211 will be a configuration, for example, includinga GPS receiving unit from the configuration illustrated in FIG. 11. Thesame will be true for the configuration of the computer ex111, thecellular phone ex114, and others.

FIG. 14(a) illustrates the cellular phone ex114 that uses the movingpicture coding method and the moving picture decoding method describedin the above embodiment. The cellular phone ex114 includes: an antennaex350 for transmitting and receiving radio waves through the basestation ex110; a camera unit ex365 capable of capturing moving and stillimages; and a display unit ex358 such as a liquid crystal display fordisplaying the data such as decoded video captured by the camera unitex365 or received by the antenna ex350. The cellular phone ex114 furtherincludes: a main body unit including an operation key unit ex366; anaudio output unit ex357 such as a speaker for output of audio; an audioinput unit ex356 such as a microphone for input of audio; a memory unitex367 for storing captured video or still pictures, recorded audio,coded or decoded data of the received video, the still pictures,e-mails, or others; and a slot unit ex364 that is an interface unit fora recording medium that stores data in the same manner as the memoryunit ex367.

Next, an example of a configuration of the cellular phone ex114 will bedescribed with reference to FIG. 14(b). In the cellular phone ex114, amain control unit ex360 designed to control overall each unit of themain body including the display unit ex358 as well as the operation keyunit ex366 is connected mutually, via a synchronous bus ex370, to apower supply circuit unit ex361, an operation input control unit ex362,a video signal processing unit ex355, a camera interface unit ex363, aliquid crystal display (LCD) control unit ex359, amodulation/demodulation unit ex352, a multiplexing/demultiplexing unitex353, an audio signal processing unit ex354, the slot unit ex364, andthe memory unit ex367.

When a call-end key or a power key is turned ON by a user's operation,the power supply circuit unit ex361 supplies the respective units withpower from a battery pack so as to activate the cell phone ex114.

In the cellular phone ex114, the audio signal processing unit ex354converts the audio signals collected by the audio input unit ex356 invoice conversation mode into digital audio signals under the control ofthe main control unit ex360 including a CPU, ROM, and RAM. Then, themodulation/demodulation unit ex352 performs spread spectrum processingon the digital audio signals, and the transmitting and receiving unitex351 performs digital-to-analog conversion and frequency conversion onthe data, so as to transmit the resulting data via the antenna ex350.Also, in the cellular phone ex114, the transmitting and receiving unitex351 amplifies the data received by the antenna ex350 in voiceconversation mode and performs frequency conversion and theanalog-to-digital conversion on the data. Then, themodulation/demodulation unit ex352 performs inverse spread spectrumprocessing on the data, and the audio signal processing unit ex354converts it into analog audio signals, so as to output them via theaudio output unit ex357.

Furthermore, when an e-mail in data communication mode is transmitted,text data of the e-mail inputted by operating the operation key unitex366 and others of the main body is sent out to the main control unitex360 via the operation input control unit ex362. The main control unitex360 causes the modulation/demodulation unit ex352 to perform spreadspectrum processing on the text data, and the transmitting and receivingunit ex351 performs the digital-to-analog conversion and the frequencyconversion on the resulting data to transmit the data to the basestation ex110 via the antenna ex350. When an e-mail is received,processing that is approximately inverse to the processing fortransmitting an e-mail is performed on the received data, and theresulting data is provided to the display unit ex358.

When video, still images, or video and audio in data communication modeis or are transmitted, the video signal processing unit ex355 compressesand codes video signals supplied from the camera unit ex365 using themoving picture coding method shown in each of embodiments (i.e.,functions as the image coding apparatus according to the aspect of thepresent invention), and transmits the coded video data to themultiplexing/demultiplexing unit ex353. In contrast, during when thecamera unit ex365 captures video, still images, and others, the audiosignal processing unit ex354 codes audio signals collected by the audioinput unit ex356, and transmits the coded audio data to themultiplexing/demultiplexing unit ex353.

The multiplexing/demultiplexing unit ex353 multiplexes the coded videodata supplied from the video signal processing unit ex355 and the codedaudio data supplied from the audio signal processing unit ex354, using apredetermined method. Then, the modulation/demodulation unit(modulation/demodulation circuit unit) ex352 performs spread spectrumprocessing on the multiplexed data, and the transmitting and receivingunit ex351 performs digital-to-analog conversion and frequencyconversion on the data so as to transmit the resulting data via theantenna ex350.

When receiving data of a video file which is linked to a Web page andothers in data communication mode or when receiving an e-mail with videoand/or audio attached, in order to decode the multiplexed data receivedvia the antenna ex350, the multiplexing/demultiplexing unit ex353demultiplexes the multiplexed data into a video data bit stream and anaudio data bit stream, and supplies the video signal processing unitex355 with the coded video data and the audio signal processing unitex354 with the coded audio data, through the synchronous bus ex370. Thevideo signal processing unit ex355 decodes the video signal using amoving picture decoding method corresponding to the moving picturecoding method shown in the above embodiment (i.e., functions as theimage decoding apparatus according to the aspect of the presentinvention), and then the display unit ex358 displays, for instance, thevideo and still images included in the video file linked to the Web pagevia the LCD control unit ex359. Furthermore, the audio signal processingunit ex354 decodes the audio signal, and the audio output unit ex357provides the audio.

Furthermore, similarly to the television ex300, a terminal such as thecellular phone ex114 probably have 3 types of implementationconfigurations including not only (i) a transmitting and receivingterminal including both a coding apparatus and a decoding apparatus, butalso (ii) a transmitting terminal including only a coding apparatus and(iii) a receiving terminal including only a decoding apparatus. Althoughthe digital broadcasting system ex200 receives and transmits themultiplexed data obtained by multiplexing audio data onto video data inthe description, the multiplexed data may be data obtained bymultiplexing not audio data but character data related to video ontovideo data, and may be not multiplexed data but video data itself.

As such, the moving picture coding method and the moving picturedecoding method in the above embodiment can be used in any of thedevices and systems described. Thus, the advantages described in theabove embodiment can be obtained.

Furthermore, the present invention is not limited to the aboveembodiment, and various modifications and revisions are possible withoutdeparting from the scope of the present invention.

Embodiment 3

Video data can be generated by switching, as necessary, between (i) themoving picture coding method or the moving picture coding apparatusshown in the above embodiment and (ii) a moving picture coding method ora moving picture coding apparatus in conformity with a differentstandard, such as MPEG-2, MPEG-4 AVC, and VC-1.

Here, when a plurality of video data that conforms to the differentstandards is generated and is then decoded, the decoding methods need tobe selected to conform to the different standards. However, since towhich standard each of the plurality of the video data to be decodedconform cannot be detected, there is a problem that an appropriatedecoding method cannot be selected.

In order to solve the problem, multiplexed data obtained by multiplexingaudio data and others onto video data has a structure includingidentification information indicating to which standard the video dataconforms. The specific structure of the multiplexed data including thevideo data generated in the moving picture coding method and by themoving picture coding apparatus shown in the above embodiment will behereinafter described. The multiplexed data is a digital stream in theMPEG-2 Transport Stream format.

FIG. 15 illustrates a structure of the multiplexed data. As illustratedin FIG. 15, the multiplexed data can be obtained by multiplexing atleast one of a video stream, an audio stream, a presentation graphicsstream (PG), and an interactive graphics stream. The video streamrepresents primary video and secondary video of a movie, the audiostream (IG) represents a primary audio part and a secondary audio partto be mixed with the primary audio part, and the presentation graphicsstream represents subtitles of the movie. Here, the primary video isnormal video to be displayed on a screen, and the secondary video isvideo to be displayed on a smaller window in the primary video.Furthermore, the interactive graphics stream represents an interactivescreen to be generated by arranging the GUI components on a screen. Thevideo stream is coded in the moving picture coding method or by themoving picture coding apparatus shown in the above embodiment, or in amoving picture coding method or by a moving picture coding apparatus inconformity with a conventional standard, such as MPEG-2, MPEG-4 AVC, andVC-1. The audio stream is coded in accordance with a standard, such asDolby-AC-3, Dolby Digital Plus, MLP, DTS, DTS-HD, and linear PCM.

Each stream included in the multiplexed data is identified by PID. Forexample, 0x1011 is allocated to the video stream to be used for video ofa movie, 0x1100 to 0x111F are allocated to the audio streams, 0x1200 to0x121F are allocated to the presentation graphics streams, 0x1400 to0x141F are allocated to the interactive graphics streams, 0x1B00 to0x1B1F are allocated to the video streams to be used for secondary videoof the movie, and 0x1A00 to 0x1A1F are allocated to the audio streams tobe used for the secondary audio to be mixed with the primary audio.

FIG. 16 schematically illustrates how data is multiplexed. First, avideo stream ex235 composed of video frames and an audio stream ex238composed of audio frames are transformed into a stream of PES packetsex236 and a stream of PES packets ex239, and further into TS packetsex237 and TS packets ex240, respectively. Similarly, data of apresentation graphics stream ex241 and data of an interactive graphicsstream ex244 are transformed into a stream of PES packets ex242 and astream of PES packets ex245, and further into TS packets ex243 and TSpackets ex246, respectively. These TS packets are multiplexed into astream to obtain multiplexed data ex247.

FIG. 17 illustrates how a video stream is stored in a stream of PESpackets in more detail. The first bar in FIG. 17 shows a video framestream in a video stream. The second bar shows the stream of PESpackets. As indicated by arrows denoted as yy1, yy2, yy3, and yy4 inFIG. 17, the video stream is divided into pictures as I pictures, Bpictures, and P pictures each of which is a video presentation unit, andthe pictures are stored in a payload of each of the PES packets. Each ofthe PES packets has a PES header, and the PES header stores aPresentation Time-Stamp (PTS) indicating a display time of the picture,and a Decoding Time-Stamp (DTS) indicating a decoding time of thepicture.

FIG. 18 illustrates a format of TS packets to be finally written on themultiplexed data. Each of the TS packets is a 188-byte fixed lengthpacket including a 4-byte TS header having information, such as a PIDfor identifying a stream and a 184-byte TS payload for storing data. ThePES packets are divided, and stored in the TS payloads, respectively.When a BD ROM is used, each of the TS packets is given a 4-byteTP_Extra_Header, thus resulting in 192-byte source packets. The sourcepackets are written on the multiplexed data. The TP_Extra_Header storesinformation such as an Arrival_Time_Stamp (ATS). The ATS shows atransfer start time at which each of the TS packets is to be transferredto a PID filter. The source packets are arranged in the multiplexed dataas shown at the bottom of FIG. 18. The numbers incrementing from thehead of the multiplexed data are called source packet numbers (SPNs).

Each of the TS packets included in the multiplexed data includes notonly streams of audio, video, subtitles and others, but also a ProgramAssociation Table (PAT), a Program Map Table (PMT), and a Program ClockReference (PCR). The PAT shows what a PID in a PMT used in themultiplexed data indicates, and a PID of the PAT itself is registered aszero. The PMT stores PIDs of the streams of video, audio, subtitles andothers included in the multiplexed data, and attribute information ofthe streams corresponding to the PIDs. The PMT also has variousdescriptors relating to the multiplexed data. The descriptors haveinformation such as copy control information showing whether copying ofthe multiplexed data is permitted or not.

The PCR stores STC time information corresponding to an ATS showing whenthe PCR packet is transferred to a decoder, in order to achievesynchronization between an Arrival Time Clock (ATC) that is a time axisof ATSs, and an System Time Clock (STC) that is a time axis of PTSs andDTSs.

FIG. 19 illustrates the data structure of the PMT in detail. A PMTheader is disposed at the top of the PMT. The PMT header describes thelength of data included in the PMT and others. A plurality ofdescriptors relating to the multiplexed data is disposed after the PMTheader. Information such as the copy control information is described inthe descriptors. After the descriptors, a plurality of pieces of streaminformation relating to the streams included in the multiplexed data isdisposed. Each piece of stream information includes stream descriptorseach describing information, such as a stream type for identifying acompression codec of a stream, a stream PID, and stream attributeinformation (such as a frame rate or an aspect ratio). The streamdescriptors are equal in number to the number of streams in themultiplexed data.

When the multiplexed data is recorded on a recording medium and others,it is recorded together with multiplexed data information files.

Each of the multiplexed data information files is management informationof the multiplexed data as shown in FIG. 20. The multiplexed datainformation files are in one to one correspondence with the multiplexeddata, and each of the files includes multiplexed data information,stream attribute information, and an entry map.

As illustrated in FIG. 20, the multiplexed data information includes asystem rate, a reproduction start time, and a reproduction end time. Thesystem rate indicates the maximum transfer rate at which a system targetdecoder to be described later transfers the multiplexed data to a PIDfilter. The intervals of the ATSs included in the multiplexed data areset to not higher than a system rate. The reproduction start timeindicates a PTS in a video frame at the head of the multiplexed data. Aninterval of one frame is added to a PTS in a video frame at the end ofthe multiplexed data, and the PTS is set to the reproduction end time.

As shown in FIG. 21, a piece of attribute information is registered inthe stream attribute information, for each PID of each stream includedin the multiplexed data. Each piece of attribute information hasdifferent information depending on whether the corresponding stream is avideo stream, an audio stream, a presentation graphics stream, or aninteractive graphics stream. Each piece of video stream attributeinformation carries information including what kind of compression codecis used for compressing the video stream, and the resolution, aspectratio and frame rate of the pieces of picture data that is included inthe video stream. Each piece of audio stream attribute informationcarries information including what kind of compression codec is used forcompressing the audio stream, how many channels are included in theaudio stream, which language the audio stream supports, and how high thesampling frequency is. The video stream attribute information and theaudio stream attribute information are used for initialization of adecoder before the player plays back the information.

In Embodiment 3, the multiplexed data to be used is of a stream typeincluded in the PMT. Furthermore, when the multiplexed data is recordedon a recording medium, the video stream attribute information includedin the multiplexed data information is used. More specifically, themoving picture coding method or the moving picture coding apparatusdescribed in each of embodiments includes a step or a unit forallocating unique information indicating video data generated by themoving picture coding method or the moving picture coding apparatus ineach of embodiments, to the stream type included in the PMT or the videostream attribute information. With the configuration, the video datagenerated by the moving picture coding method or the moving picturecoding apparatus described in each of embodiments can be distinguishedfrom video data that conforms to another standard.

Furthermore, FIG. 22 illustrates steps of the moving picture decodingmethod according to the present embodiment. In Step exS100, the streamtype included in the PMT or the video stream attribute informationincluded in the multiplexed data information is obtained from themultiplexed data. Next, in Step exS101, it is determined whether or notthe stream type or the video stream attribute information indicates thatthe multiplexed data is generated by the moving picture coding method orthe moving picture coding apparatus in each of embodiments. When it isdetermined that the stream type or the video stream attributeinformation indicates that the multiplexed data is generated by themoving picture coding method or the moving picture coding apparatus ineach of embodiments, in Step exS102, decoding is performed by the movingpicture decoding method in each of embodiments. Furthermore, when thestream type or the video stream attribute information indicatesconformance to the conventional standards, such as MPEG-2, MPEG-4 AVC,and VC-1, in Step exS103, decoding is performed by a moving picturedecoding method in conformity with the conventional standards.

As such, allocating a new unique value to the stream type or the videostream attribute information enables determination whether or not themoving picture decoding method or the moving picture decoding apparatusthat is described in each of embodiments can perform decoding. Even whenmultiplexed data that conforms to a different standard is input, anappropriate decoding method or apparatus can be selected. Thus, itbecomes possible to decode information without any error. Furthermore,the moving picture coding method or apparatus, or the moving picturedecoding method or apparatus in the present embodiment can be used inthe devices and systems described above.

Embodiment 4

Each of the moving picture coding method, the moving picture codingapparatus, the moving picture decoding method, and the moving picturedecoding apparatus in each of embodiments is typically achieved in theform of an integrated circuit or a Large Scale Integrated (LSI) circuit.As an example of the LSI, FIG. 23 illustrates a configuration of the LSIex500 that is made into one chip. The LSI ex500 includes elements ex501,ex502, ex503, ex504, ex505, ex506, ex507, ex508, and ex509 to bedescribed below, and the elements are connected to each other through abus ex510. The power supply circuit unit ex505 is activated by supplyingeach of the elements with power when the power supply circuit unit ex505is turned on.

For example, when coding is performed, the LSI ex500 receives an AVsignal from a microphone ex117, a camera ex113, and others through an AVIO ex509 under control of a control unit ex501 including a CPU ex502, amemory controller ex503, a stream controller ex504, and a drivingfrequency control unit ex512. The received AV signal is temporarilystored in an external memory ex511, such as an SDRAM. Under control ofthe control unit ex501, the stored data is sectioned into data portionsaccording to the processing amount and speed to be transmitted to asignal processing unit ex507. Then, the signal processing unit ex507codes an audio signal and/or a video signal. Here, the coding of thevideo signal is the coding described in each of embodiments.Furthermore, the signal processing unit ex507 sometimes multiplexes thecoded audio data and the coded video data, and a stream IO ex506provides the multiplexed data outside. The provided multiplexed data istransmitted to the base station ex107, or written on the recordingmedium ex215. When data sets are multiplexed, the data should betemporarily stored in the buffer ex508 so that the data sets aresynchronized with each other.

Although the memory ex511 is an element outside the LSI ex500, it may beincluded in the LSI ex500. The buffer ex508 is not limited to onebuffer, but may be composed of buffers. Furthermore, the LSI ex500 maybe made into one chip or a plurality of chips.

Furthermore, although the control unit ex501 includes the CPU ex502, thememory controller ex503, the stream controller ex504, the drivingfrequency control unit ex512, the configuration of the control unitex501 is not limited to such. For example, the signal processing unitex507 may further include a CPU. Inclusion of another CPU in the signalprocessing unit ex507 can improve the processing speed. Furthermore, asanother example, the CPU ex502 may serve as or be a part of the signalprocessing unit ex507, and, for example, may include an audio signalprocessing unit. In such a case, the control unit ex501 includes thesignal processing unit ex507 or the CPU ex502 including a part of thesignal processing unit ex507.

The name used here is LSI, but it may also be called IC, system LSI,super LSI, or ultra LSI depending on the degree of integration.

Moreover, ways to achieve integration are not limited to the LSI, and aspecial circuit or a general purpose processor and so forth can alsoachieve the integration. Field Programmable Gate Array (FPGA) that canbe programmed after manufacturing LSIs or a reconfigurable processorthat allows re-configuration of the connection or configuration of anLSI can be used for the same purpose.

In the future, with advancement in semiconductor technology, a brand-newtechnology may replace LSI. The functional blocks can be integratedusing such a technology. The possibility is that the present inventionis applied to biotechnology.

Embodiment 5

When video data generated in the moving picture coding method or by themoving picture coding apparatus described in each of embodiments isdecoded, compared to when video data that conforms to a conventionalstandard, such as MPEG-2, MPEG-4 AVC, and VC-1 is decoded, theprocessing amount probably increases. Thus, the LSI ex500 needs to beset to a driving frequency higher than that of the CPU ex502 to be usedwhen video data in conformity with the conventional standard is decoded.However, when the driving frequency is set higher, there is a problemthat the power consumption increases.

In order to solve the problem, the moving picture decoding apparatus,such as the television ex300 and the LSI ex500 is configured todetermine to which standard the video data conforms, and switch betweenthe driving frequencies according to the determined standard. FIG. 24illustrates a configuration ex800 in the present embodiment. A drivingfrequency switching unit ex803 sets a driving frequency to a higherdriving frequency when video data is generated by the moving picturecoding method or the moving picture coding apparatus described in eachof embodiments. Then, the driving frequency switching unit ex803instructs a decoding processing unit ex801 that executes the movingpicture decoding method described in each of embodiments to decode thevideo data. When the video data conforms to the conventional standard,the driving frequency switching unit ex803 sets a driving frequency to alower driving frequency than that of the video data generated by themoving picture coding method or the moving picture coding apparatusdescribed in each of embodiments. Then, the driving frequency switchingunit ex803 instructs the decoding processing unit ex802 that conforms tothe conventional standard to decode the video data.

More specifically, the driving frequency switching unit ex803 includesthe CPU ex502 and the driving frequency control unit ex512 in FIG. 23.Here, each of the decoding processing unit ex801 that executes themoving picture decoding method described in each of embodiments and thedecoding processing unit ex802 that conforms to the conventionalstandard corresponds to the signal processing unit ex507 in FIG. 23. TheCPU ex502 determines to which standard the video data conforms. Then,the driving frequency control unit ex512 determines a driving frequencybased on a signal from the CPU ex502. Furthermore, the signal processingunit ex507 decodes the video data based on the signal from the CPUex502. For example, the identification information described inEmbodiment B is probably used for identifying the video data. Theidentification information is not limited to the one described inEmbodiment 3 but may be any information as long as the informationindicates to which standard the video data conforms. For example, whenwhich standard video data conforms to can be determined based on anexternal signal for determining that the video data is used for atelevision or a disk, etc., the determination may be made based on suchan external signal. Furthermore, the CPU ex502 selects a drivingfrequency based on, for example, a look-up table in which the standardsof the video data are associated with the driving frequencies as shownin FIG. 26. The driving frequency can be selected by storing the look-uptable in the buffer ex508 and in an internal memory of an LSI, and withreference to the look-up table by the CPU ex502.

FIG. 25 illustrates steps for executing a method in the presentembodiment. First, in Step exS200, the signal processing unit ex507obtains identification information from the multiplexed data. Next, inStep exS201, the CPU ex502 determines whether or not the video data isgenerated by the coding method and the coding apparatus described ineach of embodiments, based on the identification information. When thevideo data is generated by the moving picture coding method and themoving picture coding apparatus described in each of embodiments, inStep exS202, the CPU ex502 transmits a signal for setting the drivingfrequency to a higher driving frequency to the driving frequency controlunit ex512. Then, the driving frequency control unit ex512 sets thedriving frequency to the higher driving frequency. On the other hand,when the identification information indicates that the video dataconforms to the conventional standard, such as MPEG-2, MPEG-4 AVC, andVC-1, in Step exS203, the CPU ex502 transmits a signal for setting thedriving frequency to a lower driving frequency to the driving frequencycontrol unit ex512. Then, the driving frequency control unit ex512 setsthe driving frequency to the lower driving frequency than that in thecase where the video data is generated by the moving picture codingmethod and the moving picture coding apparatus described in each ofembodiment.

Furthermore, along with the switching of the driving frequencies, thepower conservation effect can be improved by changing the voltage to beapplied to the LSI ex500 or an apparatus including the LSI ex500. Forexample, when the driving frequency is set lower, the voltage to beapplied to the LSI ex500 or the apparatus including the LSI ex500 isprobably set to a voltage lower than that in the case where the drivingfrequency is set higher.

Furthermore, when the processing amount for decoding is larger, thedriving frequency may be set higher, and when the processing amount fordecoding is smaller, the driving frequency may be set lower as themethod for setting the driving frequency. Thus, the setting method isnot limited to the ones described above. For example, when theprocessing amount for decoding video data in conformity with MPEG-4 AVCis larger than the processing amount for decoding video data generatedby the moving picture coding method and the moving picture codingapparatus described in each of embodiments, the driving frequency isprobably set in reverse order to the setting described above.

Furthermore, the method for setting the driving frequency is not limitedto the method for setting the driving frequency lower. For example, whenthe identification information indicates that the video data isgenerated by the moving picture coding method and the moving picturecoding apparatus described in each of embodiments, the voltage to beapplied to the LSI ex500 or the apparatus including the LSI ex500 isprobably set higher. When the identification information indicates thatthe video data conforms to the conventional standard, such as MPEG-2,MPEG-4 AVC, and VC-1, the voltage to be applied to the LSI ex500 or theapparatus including the LSI ex500 is probably set lower. As anotherexample, when the identification information indicates that the videodata is generated by the moving picture coding method and the movingpicture coding apparatus described in each of embodiments, the drivingof the CPU ex502 does not probably have to be suspended. When theidentification information indicates that the video data conforms to theconventional standard, such as MPEG-2, MPEG-4 AVC, and VC-1, the drivingof the CPU ex502 is probably suspended at a given time because the CPUex502 has extra processing capacity. Even when the identificationinformation indicates that the video data is generated by the movingpicture coding method and the moving picture coding apparatus describedin each of embodiments, in the case where the CPU ex502 has extraprocessing capacity, the driving of the CPU ex502 is probably suspendedat a given time. In such a case, the suspending time is probably setshorter than that in the case where when the identification informationindicates that the video data conforms to the conventional standard,such as MPEG-2, MPEG-4 AVC, and VC-1.

Accordingly, the power conservation effect can be improved by switchingbetween the driving frequencies in accordance with the standard to whichthe video data conforms. Furthermore, when the LSI ex500 or theapparatus including the LSI ex500 is driven using a battery, the batterylife can be extended with the power conservation effect.

Embodiment 6

There are cases where a plurality of video data that conforms todifferent standards, is provided to the devices and systems, such as atelevision and a cellular phone. In order to enable decoding theplurality of video data that conforms to the different standards, thesignal processing unit ex507 of the LSI ex500 needs to conform to thedifferent standards. However, the problems of increase in the scale ofthe circuit of the LSI ex500 and increase in the cost arise with theindividual use of the signal processing units ex507 that conform to therespective standards.

In order to solve the problem, what is conceived is a configuration inwhich the decoding processing unit for implementing the moving picturedecoding method described in each of embodiments and the decodingprocessing unit that conforms to the conventional standard, such asMPEG-2, MPEG-4 AVC, and VC-1 are partly shared. Ex900 in FIG. 128A showsan example of the configuration. For example, the moving picturedecoding method described in each of embodiments and the moving picturedecoding method that conforms to MPEG-4 AVC have, partly in common, thedetails of processing, such as entropy coding, inverse quantization,deblocking filtering, and motion compensated prediction. The details ofprocessing to be shared probably include use of a decoding processingunit ex902 that conforms to MPEG-4 AVC. In contrast, a dedicateddecoding processing unit ex901 is probably used for other processingunique to an aspect of the present invention. Since the aspect of thepresent invention is characterized by inverse quantization inparticular, for example, the dedicated decoding processing unit ex901 isused for inverse quantization. Otherwise, the decoding processing unitis probably shared for one of the entropy decoding, deblockingfiltering, and motion compensation, or all of the processing. Thedecoding processing unit for implementing the moving picture decodingmethod described in each of embodiments may be shared for the processingto be shared, and a dedicated decoding processing unit may be used forprocessing unique to that of MPEG-4 AVC.

Furthermore, ex1000 in FIG. 27(b) shows another example in thatprocessing is partly shared. This example uses a configuration includinga dedicated decoding processing unit ex1001 that supports the processingunique to an aspect of the present invention, a dedicated decodingprocessing unit ex1002 that supports the processing unique to anotherconventional standard, and a decoding processing unit ex1003 thatsupports processing to be shared between the moving picture decodingmethod according to the aspect of the present invention and theconventional moving picture decoding method. Here, the dedicateddecoding processing units ex1001 and ex1002 are not necessarilyspecialized for the processing according to the aspect of the presentinvention and the processing of the conventional standard, respectively,and may be the ones capable of implementing general processing.Furthermore, the configuration of the present embodiment can beimplemented by the LSI ex500.

As such, reducing the scale of the circuit of an LSI and reducing thecost are possible by sharing the decoding processing unit for theprocessing to be shared between the moving picture decoding methodaccording to the aspect of the present invention and the moving picturedecoding method in conformity with the conventional standard.

INDUSTRIAL APPLICABILITY

The arithmetic decoding method and the arithmetic coding methodaccording to the present invention are usable as an image decodingmethod and an image coding method. Such image decoding method andimaging coding method are usable in various applications includinghigh-resolution information display apparatuses or imaging apparatuses,such as, televisions, digital video recorders, car navigation systems,mobile phones, digital cameras, and digital video cameras.

REFERENCE SIGNS LIST

-   -   300 Arithmetic decoding unit    -   301 Binary arithmetic decoder    -   302 Symbol probability storing unit    -   303 Context control unit    -   304 Debinarization unit    -   400 Image decoding apparatus    -   410 Entropy decoding unit    -   420 Inverse quantization and inverse transformation unit    -   425 Adder    -   430 Deblocking filter    -   440 Memory    -   450 Intra prediction unit    -   460 Motion compensation unit    -   470 Intra and inter changing switch

1-10. (canceled)
 11. A binary arithmetic decoding method for decoding aplurality of parameters included in a binary string, the binaryarithmetic decoding method comprising: initializing a context variablefor each of the parameters, the context variable specifying aprobability of a possible value of the parameter; and arithmeticdecoding, using the context variable as an initial value, on theparameter which corresponds to a value of a given variable, wherein eachof the parameters has an initializing method from among a plurality ofinitializing methods for initializing the context variables, and whereinin the initializing, either one of a first initializing method and asecond initializing method different from the first initializing methodis selected for the parameter from among the plurality of initializingmethods, (i) the context variable being initialized by the firstinitializing method when the first initialized method is selected and(ii) the context variable being initialized by the second initializingmethod when the second initialized method is selected.
 12. An arithmeticcoding method for coding a plurality of parameters included in a binarystring, the binary arithmetic coding method comprising: initializing acontext variable for each parameter, the context variable specifying aprobability of a possible value of the parameter; and arithmetic coding,using the context variable as an initial value, on the parameter whichcorresponds to a value of a given variable, wherein each of theparameters has an initializing method from among a plurality ofinitializing methods for initializing the context variables, and whereinin the initializing, either one of a first initializing method and asecond initializing method different from the first initializing methodis selected for the parameter from among the plurality of initializingmethods, (i) the context variable being initialized by the firstinitializing method when the first initialized method is selected and(ii) the context variable being initialized by the second initializingmethod when the second initialized method is selected.